A DISPLAY EVALUATION METHODOLOGY APHJEO 
TO VERTICAL SITUATION DISPLAYS* 


Sheldon Baron 
William W, Levlson 

Bolt Beranek and Newman Inc. 
Cambridge* Massachusetts 


1. INTRODUCTION 

in spite of vast efforts in display design and evaluatlon« 
there do not appear to be standardised procedures for evaluating 
aircraft displays, instead# a variety of techniques are employed 
in the several stages leading to an aeoeptable display oonfigura~ 
tion# with man- in- the- loop real-time simulation experiments playing 
a central role, while there are a number of valid reasons for the 
techniques that have been used [1]# it seems fair to say that there 
exists a reed for unifying concepts and approaches. 

Analytical models of the pllot-vehlele-dlapley system appear 
to offer the possibility of a systematic# well-defined and compre- 
hensive approach to display evaluation. Such models allow one to 
examine the interactions of displayed information with vehicle 
dynamics, disturbances# mission criteria and human performance* 

They may be used to provide early and preliminary evaluation of 
competing configurations without the necessity for expensive 
simulation! in later stages of display development# the models 
can serve as powerful diagnostic and extrapolative adjunots to 
the necessary simulations. 

The advantages of ai.lytlcal models for display evaluation 
have been we 11- under stood for some time and considerable effort 
has been expended in their development* Perhaps the most exten- 
sive effort to dste is represented by the work of Allen# Clement 
and Jex (2) and McRuer# et al. 13). They attempted to synthesise 
the human operator scanning model of Senders {4)# multi-loop 
describing function theory (5) and Clement's theory of human 
signal reconstruction (6) into a theory for displays in manual 
control. 

In this paper# an approach to display evaluation based on 
the optimal-control or state-variable model of the human operator 
(7-10) is described. The approach has evolved over the pest 
several years (11-14) and ws believe it has significant advantages 
for display evaluation. In the remainder of the paper# we describe 
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briefly the foundations of the methodology* and preaent results of 
its application to the analysis of vortical situation display for 
STOL approach. This analysis lnoladaa th* affaots of both statu, 
and c o mm a n d displays on pilot workload and system performance. 

Mor. detail ooaeemlng th* results and ids as pr***nt*d h*ra ear 
b* found in (IS). 



3. DISPLAY EVALUATION METHODOLOGY 

Th* following four atop* are fundament* 1 in th* application 
of th* display evaluation methodology i 

1. Specification of system dynamics « disturbances, 

and task retirements in term of a linaer-guadratie- 
gauesian optimisation problem suitable for application 
of th* optimal control model of Che human operator 
( 8 , 10 ). 

a. Analysis of proposed display configuration with 
respect to display characteristics end their rela- 
tion to parameters of the human operator model. 

3. Determine performance with given configuration and 
investigate the effects of elimination of display 
limitations . 

4. Analyse display work load-par focmanos tradeoffs via 
sensitivity analysis. 

System 6p»eifioatien 

System dynamics arc approximate by th. following linear 
etato eg cat ion i 

&"&*+&!+£& <i> 

where x(t) is the vaster of system states, u(t) the vaster of pilot 
control inputs and w(t) the vector of linearly Independent whies 
gauaaian noises, t? external forcing function* are rational 
gauesian noise speetra of first order or higher as la th.- case 
fox meat turbulence models (161 , they are represented by white 
noise (w) passed through a linear filter and the system dynamics 
are augmented by ehoeo of tho filter. Dieturbaneoe such as oonetane 
wind, or wind-shears are modelled, essentially, by adding non-aaro 
mean components to g (14, IS), 


*A detailed description of tho optimal control modal of tho human 
operator ia not given as it has already bean well-documented 
(7-10, e.g.I. 
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The display* variables are assumed to be linear combinations 
of the state arcl control variables and are given by the "display- 
vector" 

£(t) “ £ ♦ £ u(t) (2) 

As with the input, display dynamics are included by introducing 
additional system states and augmenting the matrices in Equation (1) # 
Such is required, for example, in analyzing certain flight director 
configurations. 

Task requirements are stated in terms of "cost weightings” 
associated with various system variables in a quadratic coat 
functional of the form 

J (u) ■ E {£' g £ + u # R u ♦ u* G u} (3) 

It is assumed that the pilot selects his control response to mini- 
mize the appropriate J. For relatively simple, single* variable 
control sltuatlor. s, good approximations to experimental measure- 
ments have been obtained with a cost functional consisting simply 
of a weighted sum of system error variance plus control-rste 
variance (5) . The cost on control- rate represents, in part, a 
subjective penalty Imposed by the controller on making rapid 
control motions and may account, indirectly, for physiologies! 
limitations cm the pilot's bandwidth* 

For complex multi-input, multi-output taaka, the coat weigh- 
tings may not be chosen in so simple a fashion. One approach la 
to select’ values for the weightings so as to keep mean-squared 
output levels within prescribed tolerances [17). A unit amount 
of "cost" is associated with a given variable when the magnitude 
of the "error" equals the nominal limit, end the weighting 
coefficient for each variable is simply the inverse of the 
square of the corresponding limit. This approach was used in 
the application to be discussed later. 

For the present paper, the matrices introduced in aquations 
1-3 are assumed constant. This corresponds to a condition for 
which we have the moat validation data but it is not a necessary 
restriction. For example, in a companion paper (18) end in [15], 
range (time) -varying display gains and coat functional weightings 
are included in the analysis. 

Analysis of Display Configuration 

A basic assumption of the optimal control model of the human 
operator is that the human perceives a noisy, delayed version of 
the displayed variables t l.e«, if Vplt) If the vector of perceived 
variables, then 

£p<t) • £(t-t> ♦ Vy( t-r) (4) 
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where £ is defined by Equation 3, and vy is a vector of white, 
gauss lan observation nolsst . * when the displays have been opti- 
mally designed as is the case in many laboratory situations, central 
prooeasing sources of pilot rsndomneas appear to be the prinelpel 
determinant of vy. Thus, we find for manual control situations 
in whioh the displayed signal la large enough to negate the effects 
of visual resolution < "threshold") limitations, the auteoovariance 
of eaoh observation noise eomponent appears to vary proportionally 
with mean squared signal level and may He represented as 

v yi (t> - » Pi • B(y'(t)) 

(5) 

• « Pi Oy^t) 

where P is the "noiaa/algnal ratio" and has units of normalised 
power per rad/see. Humeri os 1 values for P* of 0,01 U»e., *20 dB) 
have been found to be typloal of a ingle- variable control situations 
( 9 , 10 ). 

when display characteristics are not ideal it is necessary to 
modify the expression for the observation noise covariance associa- 
ted with e particular display variable. In this study, two display 
limitations wars important under certain circumstances , namely 
threshold limitations and the lack of a sero reference. We account 
for these phenomena by letting the autoeovar lance for each observa- 
tion noise process be 


v A <t) 



< 6 ) 


where the subscript 1 refers to the I th display-variable • The 
quantity Mo*, a*) in Equation 6 la the describing function 
gain associated with a threshold device 


K(o» A) * 

✓¥ 



where "a" is the threshold and a is the standard deviation of the 
"input" to the threshold device.*" This factor is used primarily 
to acoount for threshold-type phenomena associated with viewing 



t - ,15 - ,2 sec. 


T 9 


ie a parameter of t^a models typically, 


**For non- zero mean algnels this axpraaaion r t be modified (14). 
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the display, but "indifference” thresholds will have an indistin- 
guishable effect. Essentially, its effect is to cause the observa- 
tion noise covariance to become greater as the signal becomes 
smaller relative to the threshold. 

The term a\ Q in (6) is a residual-noise covariance and, in 
many cases, is similar in effect to a threshold. However, it 
can be viewed as a separate parameter and used to account for 
observed degradation in tracking performance that results from 
lack of reference Indicators (15]. 

Performance Evaluation 


Workload Analyoi* 

As noted earlier, the observation noise/signal ratio. Pi, seems 
to be assoeiated with the operator's central processing capabilities. 
This association leads to a relatively straightforward model for 
task interference and operator workload. The details of this model 
are given in (19]. Very briefly, we consider, for convenience, 
that attention-sharing may be required at three levels t between 
manual oontrol and non-control tasks; between sub-tasks within the 
manual oontrol task; and between displays associated with performing 
a given sub-task. For example, a pilot might share attention between 
control and communication, between longitudinal and lateral oontrol 
and between flight path and attitude displays. Thus, we define 


Once the system and human parameters have been chosen, per- 
formance can be evaluated. Although, for model development, task 
requirements are specified in terms of the quadratic cost functional 
J of Equation 3, other measures of performance are important in 
problem analysis. For many problems a useful system metric relates 
to performance reliability, or the probeblllty of achieving mission 
objectives successfully. The success of a mission (segment) can 
often be stated in terms of constraints that the system states 
(or outputs, or controls, or functions of these variables) must 
satisfy. In other words, mission success may be equated with 
y c X. Then, the probability cf success is, simply, 

Pr (r. e X) • f p(x)dx (7) 

x c X ~ “ 

where p(x) is the probability density function for x. An example 
where such a specification of success is meaning ful~is approach to 
landing (see below). Because of the llneari y and gausslan assump- 
tions, p ( x ) (and p(£), p(u), etc.) is obtained in a single run of 
the optimal control model^for the human operator. 

The probability of success, as defined in Equation 7, is for 
the total man-macnxne system and the particular mission segment 
being analyzed. This probability is, in fact, a conditional one 
in that its computation depends on the particular system and 
model parameters chosen in Equations 1-6. Thus, through model 
analyses, success or failure probabilities may be determined as 
functions of any parameter (s) of interest. In particular, for 
display evaluation, one can Investigate systematically the 
effects on performance reliability of changes in display charac- 
teristics. Because of the structure of the model, one can also 
compute the performance that could be attained with an idealized 
display; this provides a useful basis for comparison and analysis. 


f t * fraction of attention devoted to the control task as a whole 

f. • fraction of attention devoted to sub-task s 

f" ■ fraction of attention devoted to i*h display in sub-task • 

Then, the effects of attention-sharing are modelled by an Increase 

in the "nominal” noise/signal ratio, i.e«, by 



(9) 


where is the nolse/signsl ratio assooiafcsd with ths 1 th display 
when attention la baing shared and P 0 is the noise/signal ratio 
associated with full attention to the display. 


To prsdict ths offset on specific tasks of sharing attention. 
Equation 8 is used to establish the appropriate observation noise- 
signal ratios and the model equations are solved using this value. 

Zf the pilot's allocation of attention is unknown beforehand, model 
solutions may be used to determine the optimum allocation of atten- 
tion, which, in line with the fundamental optimality hypothesis, 
may be taken as a prediction of the pilot's allocation. 

Building on ths jodel for attention, we define a "workload in- 
dex" as the fraction of attention required to achieve a specified 
criterion level of performance en the oontrol task. Thus, 

Workload *ndmx - 

c 

whore f t c !• the minimum fraction of attention for which perfor- 
mance can be maintained within the criterion level. Zn order to 
predict the workload index, it is necessary to specify a relevant 
performance measure, the fequired level of performance, and the 
"reference" noise/signal .ratio P©. Ideally, we would like P 9 to 
correspond to full attsnt .on, but ws cannot conduct an experiment 
in which the pilot is guaranteed to use bis total ' n format lon- 
proeesslng capability. Therefox*, we let P e cor aspond to the 
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noise/aignal ratio (namely, .01 or -20 dfi) obtained in a standar- 
dized laboratory situation in which the pilot is motivated to 
minimize his tracking errors. We know that this value does not 
correspond to "full capacity", because significantly lower noise- 
ratios have been found experimentally (19], However, based on 
our laboratory experience, P 0 ■ -20 dB does appear to correspond 
to a high workload condition, and "operation” at this level for 
any prolonged time would undoubtedly be unacceptable. Of course, 
when we are interested primarily in the relative change in workload 
requirements from one situation to the next, the value for P 0 is 
not too critical. 


3. ANALYSIS OP VERTICAL SITUATION DISPLAYS FOR STOL APPROACH 

The display evaluation methodology has been used to analyse 
basic status displays and director displays for the steep <7, 5”) 
approach to landing of the Augmencor Wing Jet STOL Research 
Aircraft (AWJSRA) • The displays were analysed primarily with 
respect to steady-state, gust regulation performance at the 
decision height (approximately 30m) , though other supporting 
studies were also conducted (15, 18], Hers, we describe the 
basic display configuration that was investigated and present 
some of the more interesting and more Important results. Perfor- 
mance predictions are presented for lateral control and for eo*s- 
bined lateral- longitudinal control. Results for the longitudinal 
control case are given in [5]. Details concerning vehicle dynamics, 
turbulence spectra, cost-functional weightings, and other parameters 
of the system-human operator model are given in (15), where more 
extensive presentation and discussion of results may also be found. 

An abstraction of the relevant features of the STOLAND-BAOI 
status display (20] considered here is shown in Figure 1, This 
display provides the pilot with glide path and loealiser errors 
as well ae attitude information. From such a display the pilot 
can also obtain the rates of change of theae variables. Although 
an airspeed error Indicator is not shown in Figure 1, the pilot 
is displayed this quantity with the STOLAND-BADI and we will 
assume that airspeed error is available in our analysis. 

Effective visual thresholds wsra computed for the aircraft 
at the 30-meter decision height. On the basis of previous analysis 
of approach performance (14), an "indlfferenoe threshold* of 0,1 
degrees visual arc was associated with perception of height error. 
Previous analysis of pilot remnant data (13) suggested thresholds 
of 0,05 degrees visual arc for other indicator displacements and 
0.18 arc-degrees/second for Indicator- rate quantities. Display 
gains given in (20] were used to convert thresholds into units 
related to system quantities. 
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FIGURE l. Display of 8tatus Information 
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Non-zero rms real dual noise terms were associated with height 
and sink-rate information* Because the display shows the height 
•window" of £3.7 meters # a residual noise on height perception 
was needed to account for the lack of an explicit zero reference. 

To approximate the effects of the non-zero reference, the value 
of the residual noise was set equal to the amount of the reference 
offset (i.e . , 3.7 meters). The residual noise on sink-rate infor- 
mation was included to account/ in a rough way, for the resolution 
limitations of a Scanning Beam Instrument Landing System. However# 
the latter noise term was found to have no appreciable effect on 
predicted performance. A non-zero rms residual noise term was 
also associated with lateral offset error. This was set to a 
value of 5.4 meters, corresponding to the lateral dimensions of 
the "window". Studies of longitudinal control showed that the 
thresholds on attitude could be Ignored, so in the analysis of 
lateral performance the thresholds associated with viewing the 
bank angle Indicator were set to zero. Thresholds and residual 
noises for all displayed variables are summarized in Table 1. 


Table 1 

DISPLAY -RELATED PARAMETERS 


Variable 

Threshold 

RMS Residual 
Noise 

Altitude error (m) 

0.4B 

3.7 

‘ Sink-rate (m/s) 

0.85 

1.1 

1 Fitch (deg) 

0.22 

0.0 

. Pitch-rate (deg/s) 

0.78 

0.0 

Airspeed error (m/s) 

0.14 

0.0 

! Lateral error (m) 

; *28 

5.4 

| Lateral error rate (m/s) 


0 

j Bank angle (deg) 

0 

0 

' Roll rate (deg/s) 

0 

0 


To evaluate various display configurations it was necessary 
to choose a performance metric. Although rms error scores were 
used as raw measures# it was decided to evaluate the displays 
in terms of the probability of not meeting Category XI# approach 
window specifications# i.e.# in terms of probability of a "missed 
approach", of course, the missed approach probability is a function 
of gust intensity. Both# a worst-case wind- and a madlan-wind- 
condition, were investigated ." Because the relationship between 
rms performance and gust intensity Is nearly linear (15) and the 


"Given that turbulence occurs (P r *.0)# winds of intensity equal to 
or greater than that of the worst-ease (median) wind will be 
encountered 1% (50%) of the time. 


probability density for turbulence intensity la known (16)# one 
can use the results for the two wind conditions to predict a 
measure of system performance that ie averaged over ell possible 
wind conditions. Such an overall system performance measure was 
also obtained in many cases. 

Longitudinal and lateral displays wsrs first analyzed 
separately. This was possible because of the decoupling inherent 
in the assumed linearized perturbation equations. Of course# the 
pilot must shers his capacity between the longitudinal and lateral 
tasks# which implies some Interference and a degradation in per- 
formance on each task. This interference was treated within the 
framework of the model of attention presented earlier. 

To account for the interference# we define a combined cost 
functional 

J T0T * J L0WJ * J LAT 

where Juom <?LAT ere the cost functionals for the longitudinal 
and lateral cases, respectively. The combined cost functional is 
meaningful because of the manner in which the weightings in the 
separate cost functionals were chosen. Now# if fLOWC 1 b the 
fraction of attention devoted to the longitudinal task, then for control 

f LAT “ 1 " f LO*KJ 

Xt is therefore possible to determine how attention should be 
shared between the two control modes so as to minimize J total* 

Status Display 

The first stags of the analysis of the lateral displays was 
a sensitivity study to determine the optimal allocation of atten- 
tion between localizer and bank angle displays." It was found 
that psrfonenee was not very sensitive to allocation of attention 
between theae displays. Neverthess# about 75% attention to locali- 
zer# 25% to bank angle indicator was beat in a high workload 
situation (15) and this attention-split was assumed for the 
remainder of the analysis. 

Lateral tracking performance wee computed for the worst-ease 
and median winds and these rms scores were used to compute a 
composite score for an •all-winds" average. This was done for 
several levels of total attention devoted to the lateral task. 

The results in terms of missing the lateral approach window 
(5.4m) are given in Figure 2. They reveal that the lateral 
control teak, even with the SAS-on# ie very difficult. (The 
probability of missing the lateral window when averaged across 
all winds is l.S - 3 times as great as that for missing the longi- 
tudinal window at all levels of attention investigated.) Xf a 95% 


"Because o? the nature of the EADX overt visual scanning was not 
considered. 
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PROBABILITY OF EXCEEDING LATERAL WINDOW (PERCENT) 



Fici’RF 2. Effect of Attention on lateral Window Performance 

U 


cl26 


probability of a successful lateral approach is selected as a 
criterion level, the Workload Index for the lateral task for the 
50% wind is about .4, and it is about .7 when the average of all 
winds are considered. For the II wind, it does not appear that 
a success probability of 951 is achievable within the limits of 
human behavior that we have observed heretofore. 

The effects cf sharing attention between longitudinal and 
lateral control tasks on window performance, averaged over all 
winds is shown in Figure 3. Using the probability of a missed 
approach as the measure of performance leads to the conclusion 
that approximately a 40/60 split of attention between longi- 
tudinal and lateral tasks is optimal. The corresponding overall 
probability of a missed approach (i.e., a miss on height o r 
airspeed or lateral position) is about 8%. We can use these 
results an3 those for longitudinal control to obtain missed 
approach probabilities as functions of the relative attention 
devoted to the tracking task as a whole (assuming, for conve- 
nience that the pilot splits attention equally between the two 
tasks and that "full" attention * -20 dB) . The result is plotted 
in Figure 4. This figure emphasises the difficulty of the task. 
When all winds are considered, it does not appear possible to 
achieve a 95% approach success probability, at least within the 
range of pilot workload that is assumed acceptable. Even for 
the 50% wind condition, a success probability of 95% Implies a 
Workload Index of about .9, hardlv a desirable situation. 

In an attempt to determine potential improvements in the 
lateral display, an analysis of the sensitivity of performance 
to changes in display parameters wss conducted (for the worst- 
case wind and a high workload (P 0 - -20 dB) condition) . The 
following display improvements were considered in cumulative 
fashions A) nominal EADX-Status Displays B) removal of 
residual noise associated with lateral error (providing a zero- 
reference) ; C) zero threshold for lateral error-rates D) zero 
threshold for lateral errors E) no modification of noise/signal 
ratios for attention-sharing (display integration) • The results 
of the analysis are given in Table 2. 


Table 2 

EFFECT OF DISPLAY PARAMETERS ON LATERAL PERFORMANCE 


Condition 

A 

B 

C 

D 

E 

o y (m> 

5.09 

5.05 

4.89 

4.87 

4.59 

Of (m/s) 

2.0 

1.99 

1.96 

1.95 

1.88 

o^ldag) 

5.04 

5.03 

4.97 

4.96 

4.71 


10.6 

10.4 

10.4 

10.4 

9.8 
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ATTENTION TO LONGITUDINAL TASK 


FIGURE 3 


Effect on Approach Performance of Attention Sharing 
Between Longitudinal and Lateral Tasks 


ALL WINOS 



RELATIVE ATTENTION TO TRACKING TASKS 


FIGURE 4. Effect of Attention on Missed Approach Probability 
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Performance improvements with display changes are not too 
dramatic, with the cumulative improvement in tracking performance 
being about 10% • Of the changes made, only two had any significant 
effect! namely, removing the lateral error rate threshold and re- 
moving the necessity for attention -sharing. 

Director Display 

A flight director display could remove threshold limitations 
and alleviate the requirement for display integration and, thus, 
realize the performance improvement possible with the idsalizsd 
display of condition E. The actual performance improvement 
attained might not be substantial in terms of lateral error 
(about 10% according to Table 2) . However, the flight director 
might allow achievement of similar performance at reduced work- 
load, i.e.« it might reduce the workload index* 

An "interim" lateral flight director system for the AWJSRA 
has been described in [21]* we analyzed an approximate version 
of that system, as shown in Figure 5* It should be noted that 
we assume here that lateral flight path angle may be obtained 
directly rather than by means of the complementary filtering 
techniques of (21]. Although this assumption is somewhat un- 
realistic, the idealization should provide a bound on the perfor- 
mance* improvements that can be expected of the more practical 
system* The gains for the lateral director system correspond to 
case 2F of (21)* 

The effects on rms performance of sharing attention between 
the Jateral flight director and the lateral displays of the EADZ- 
Status display (considered as an entity) were investigated* It 
was assumed that the portion of attention devoted to the status 
display was allocated between the localizer and bank angle indica- 
tors in the aoproximately optimal 3:1 ratio mentioned earlier. 

The results indicated that about 80-90% attention to the flight 
director is "optimal”, but performance was very insensitive to 
changes in attention [15). Results for the 80% division of atten- 
tion were quite close to those for the idealized display! lateral 
error was about 3% greater for the flight director-status display 
combination and other variables were virtually identical. Even 
when only the flight director is available, there is not a signi- 
ficant increase in lateral error. In general, then, the attention- 
sharing results indicate that the "interim” lateral flight director 
comes close to achieving the improvements implicit in an Idealized 
display* On the other hand, the improvements at the level of 
attention (-20 dB) and wind- condition (1%) investigated were not 
large indicating that , when working hard at the task, one can 
perform almost as well with the status displays as with the 
director* 
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FLIGHT DIRECTOR COMPUTER 





The improvement provided by adding the lateral flight directox 
to the status displav at various "levels" of attention is shown 
in Figure 6. Averaged over all wind conditions f the probability 
of a missed approach without the flight director is 1.5 to 2 
times greater than with it - at all levels of attention. Moreover , 
the improvement is greatest in the range of operation (attentions 
of .5 to .125 that are likely to be most important. For the 50%- 
wind (also shown in Figure 6) , the flight director provides even 
more substantial improvement. 

In terms of workload, an approach succe ss probability of 
99% is unattainable, with reasonable workload/ when all winds are 
considered? for the 50%-wind, «:he flight director reduces the 
workload Index from about 1.4 to about .3. For the all-winds 
average, a 95% success orobability requires a workload index of 
about .7 in the no-director case as opposed to about .25 when 
the director is available. In general, the curves of Figure 6 
indicate that addition of the flight director will reduce the 
lateral workload by a factor of 2-4 for success probabilities 
that can be achieved, with greatest improvement in the range? of 
most interest. 

The total lonoitudina 1-lateral approach task with flight 
directors for both control tasks* was analyzed in exactly the 
same fashion as for the status display configuration. The 
results are presented in Figure 7, When the average of all- 
winds is considered, the addition of the flight-directors 
reduces che miss probabilitv by about a factor of two, with 
the most improvement in the lower attention levels. Even 
area ter improvement (4-7 times better) is evidenced for tht 
50%-wind condition. The missed approaches, for the all-winds 
average , are die largely to the lateial task? although not shown, 
th: ■* is even more true for the 50%-wind condition. 

Figure 8 shows the tradeoff between workload and performance 
for the 50%-wind condition. The directors cut the workload by at 
least f third in the range of success probability of 95-99%. A 
similar reduction in workload is possible for the all-winds 
average, but the probability of success is much reduced. (The 
workload index for a 95% success probability is about .7 with 
the directors as opposed to 2 without them.) 


4. CONCLUSMS 

A display evaluation methodology based on the optimal control 
model of the human operator has been described and applied to the 
analysis of vertical situation displays for STOL approach. The 
methodology appears to provide a powerful means for analyzing 


Th«T ^Interim" longitudinal directors for nozzle and elevator 
control were approximations [15) to those proposed in (21). 
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PROBABILITY OF MISSEO APPROACH (PERCENT) 
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displays and their effect on system performance and reliability* 

It may be used to determine bounds on expected display improvements 
via analysis of "idealized" displays. The model for task inter- 
ference and workload permits linearized analysis of combined 
longitudinal and lateral performance in a rational and consistent 
manner. Interaction between axes is introduced via the limited 
capacity of the pilot and not through any vehicle coupling. The 
analysis techniques can also serve as a basis for director design. 
Such a (preliminary) procedure for design of a longitudinal director 
system, that considered only the gust- regulation problem, yielded 
a configuration that resulted in substantially reduced workload [221. 

The performance of the AWJSRA with an "un augmented” EADI -Status 
display was analyzed with respect to both "window" performance and 
pilot workload, for « range of turbulence conditions. The results 
indicate that with the basic display the overall task is quite 
difficult. When the median wind level is considered, a 95% success 
probability for approach requires a high workload. If performance 
is averaaed over all possible winds, such a success-probability 
does not appear to be attainable within a reasonable range of 
workload. The lateral-directional task seems to be considerably 
more difficult than the longitudinal control task, even though 
stability augmentation is provided for lateral control. For a 
95% probability of being within the respective approach window, 
the lateral task has a workload index about 2.5 times that 
for longitudinal control. 

Potential improvements to the basic display were also explored. 
The greatest effects were observed when better error-rate (sink- 
rate, lateral error-rate) information was assumed, as might be 
provided, for example, by a display of longitudinal and lateral 
flight rath angles. Significant effects were also observed when 
the requirements for attention-sharing were removed. These 
improvements, as well as a reduction in pilot workload, may be 
realizable with suitable flight-directors. 

Analysis of suggested longitudinal and lateral flight director 
systems confirms that performance is improved and pilot workload 
is reduced by a significant amount. When the average of all-winds 
is considered, reducing the probability of a missed approach to 5% 
still requires a nigh workload. However, for a median-wind condi- 
tion the directors reduce workload requirements to values that 
seem well within capabilities. 
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